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OVERVIEW 



■ The purpose of this .study was to develop an instrument that would, vith validity 
and reliability, provide objective ratlicr than impressionistic data about problem 
solving and communication patterns within complex organizations. The strategy for 
satisfying that purpose included : ^ 

1. Searching the literature to build .a nomological network thait related 
to the two constructs, problem solving and communication. 

"2. Developing questions from the nomological network that when responded 

to by. top and middle management and when analyzed would provide informa- 
tion to allow management to move effec tively , through training, to - 
improve the capability of managers; in large organizations to solve 
problems and to communicate . 

3. Applying the instrument in a large organization as a test case so that 
data could be gathered to point out the validity and reliability of the 
instrument. T;;' 

4. Using accepted scientific approaches to show the validity and^ reliability 
of the instrument. V 

What was done ■ 

Development of the instrument . The* literature was searched for concepts that 
would relate to the central constructs, problem solving and communication. Nine 
obstacles . to proj^lcm solving and communication were identified from the literature 
(Appendix A) and designated first-lev.el nomologicals within the nomological network.. 
The nomological network was. subsequently used to predict the relationships between 
the central constructs and the items on the questionnaire. Further search of the 
literature identified varying aspects of each first-level nomological. These aspects 
were called secopd-level nomologicals. From the second-level nomologicals, specific 
questions were written by the author for inclusion on the questionnaire . The infer- 
ential steps in arriving at the questions. from the constructs were, therefore, 
publicly and. explicitly stated,- satisfying that requisite for claiming construct 
validity. A further consequence of this process was that the questions for the 
questionnaire were articulated and teady for assembly in the form that was used in 
the test case . 

The test case . The questionnaire was tested using top and middle management 
at Dorothea Dix Hospital, a. state operated mental health facility located in Raleigh, 
Nor th .Carolina. Of the 128 questionnaires distributed 118 were properly completed 
and returned, producing a response level of 92.19 percent. 

The questionnaire was introduced to the "prospective participants through 
highly personalized small group presentations.. The presentation topics included 
purpose, anticipated outcomes, expected follow- through, and the level of interest 
on the part of the hospital's top management in the outcomes. This approach was 
adopted to increase reliability, since introducing the questionnaire that way 
tended to reduce measurement errors by making all items and instructions "perfectly 
clear" to the respondents* 




The respondents roc.oived tho (|uesLionnairc in- personally addressed envelopes, 
containing-a cover letter from the hospital superintendent , instructions for partici- 
pants, the questionnaire, and return envelopes^ Two weeks were allowed for completion 
of the questionnaires and no follow-up took place for delinquent questionnaires" 
except in the/case of the hospital's top management, ' . ^ 

The data were analyzed, to provide information to the hospital's, top management • 
The format of the anal yzed information given to the executives was a list of first- 
level nomologicals ranked in sequence of priority for action. The priority statistic 
was,, the principal input to the development of- action programs to strengthen the 
ability of hospit'al management to do problem solving and communication. 

ValidiTt^. The nomological network made public the inferential relationships 
of the -questions on the questionnaire, to the constructs , problem solving and communi- 
cation. It was also essential that contact with observables be demonstrated in order 
to justifiably claim construct validity. The way. used to provitie the link-age between 
the constructs and observables was to factor analyze the response^ of the participants 
in the test case. / 

As was expected the factor analysis showed the constructs to be nnal ti-dimensional. 
The theoretical network of nomologicals also made reasonably realistic contact with ' 
observables, considering the needed trade-offs between theoretical purity and 
questionnaire utility in measuring the' real social situation of the test case« 
Based on the study having satisfied the prerequisites for construct validation, 
constrx.ict validity was claimed for the questionnaire. - 

_ • \ : ■ - ' 

. Reliability . An analysis of variance was produced 'which provided input to a 
formula to calculate Cronbach's Alpha, which is a descendant of Kuder-Richardson Vs 
"20" and is. a measure of the internal consistency of the questionnaire. Alpha was : ■ 
high enough to be reassuring and the value of the .standard error was Vow enough to 
be acceptable. An additional "reliability-like" calculation was accomplished , where 
a correlation was taken between the mean responses of various distinct subgroups 
within the, test population** The correlations were very high. The instrument was 
declared- reliable. 



Potential for . fu turd research 

In-depth priority scheme . The scheme for stating priority- of obstacles to be 
addressed by training programs is currently at the level of. the first-level nomo-^ 
logical, which, can be described as the level of the "grand scale." A logical follow- 
through would be to produce, a priority schedule that is at th^ second-level nomo- 
logical, so. that action might be taken *to rectify the symptoms, themselves, as a 
means. of "curing the disease" of the obstacle (or first-level nomological) to 
problem solving or communication. ' - , 

Prescriptive system . A more interesting (to the author) opportunity is to use 
the instrument in a large number of organizations from a variety of industries, 
first establishing a profile , of the organizations and the way they operate, -and then 
applying the questionnaire. The goal would be to identify what was being done in the. 
various organizations' that was different, that could be related . to ' the'low priority 
items, and, ultimately, to build a prescrip'tive system for overcoming the ills of 
various organizations, based on what one organization was 'doing well that another., 
was not. In other words the end product of the research would' be a highly objective 
cause and effect system to analyze organizational ills and to prescribe cures for 
those ills, based on the successful, experiences of other organizations. 



* ^se of the instrument 

The questionnaire is intended to provide management information that will be 
useful in strengthening a large organization's ability to succeed in problem "solving 
and in communication^ The principal mo rhod originally anticipated for the stroagtfi- 
ening process, was training of the stall in topics specific to the obstructive factors 
(first-level nomologicals) that scored high in the priority calculation. The test \ 
case suggested that the information providedjby the priority statistic is also, for\ 
observant managisrs, useful-for planning organizational activities other than training 
that may help strengthen problem solving and commtmicatlon in the organization. In \ 
the instance of the test case' modifications to ma^ement practice and the initiation 
of action programs were considered by the organization's management more significant \ 
to the organization than were the training activities that resulted from the study. \ 
In other words the information provided thrbugh application of the. questionnaire and 
analysis of its results has. uses that are broader than those initially anticipated. 



\ 
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■ "DISCUSSION. OF VALIDITY AND RELIABILITY 

\ - ' AND THEIR APPLICATION TO Tlffi INSTRIMLNT 

' . A • ■ ' - ■ ■ ■. ■■ ' - ' 

This section deals with validity and^ reliability as applied to the instrument. 
The section is organiz.ed so that a' brief review of relevant literature, exploring a 
basic concept, precedes the discussion of the way in which the concept is applied to 
the- study. The purposeXfor organizing the section this way is to assure that at the 
time the application of the concept to the study is discussed the reader has 
essentially the same perspective o£ the concept as the author. 

\ . _ 

.■ \ 

-Validity ' :. . . . , ' ' . 

Four types of validity hr\^vo become generally accepted as a result of their 
being (in effect) approved by the American Psychological Association (Technical 
Recommendations, 1954), by the American Educational Research Association, and by 
the National Council on Measurements Used in Education (Committee on Test Standardi- 
zation, 1955). These four types\are "concurronl'* validity, "predictive" validity, 
"content" validity, and "construct" validity. \ 

Criterion oriented validation A The first t\yfo categories, concurrent validity 
and predictive validity, may be considered togothor^as "criterion-oriented" valida- 
tion procedures (Cronbach and Meehl, 1955). Criterion validity refers to. the corre- 
lation between one measure and a direct measure of the concept being considered. 
The direct measure is assumed to correspond exactly, or nearly so, with the concept. 
The pattern of criterion-oriented validation begins with an investigator who is 
primarily interested in some criterion he wishes to predict. He applies his instru- 
ment^.^-ob tains an independent criterion measure on the same subjects, and then computes 
-a-^ correlation. If the instrument Is applied at the same time as the independpnt cri- 
terion, the investigator is concerned with concurrent validity. 

Examples ot problems in predidtive validity would include the instances in which 
an investigator seeks to develop an\ instrument that will accurately predict in 
January the outcomes of a general el^ection to be held the following November, or in 
which, a researcher attempts to ci,evel6p an instrument that may be administrered to 
high school students to predict success in college. An example of a problem in 
concurrent validity would be to administer a test on basic concepts- in sociology ^to 
a sociology class and at the same time receive a report from the class instructor ps 
to the, abilities of the students with respect to the area being tested; 

Content validity . Content validity is essentially . judgment'. It is presenting 
a reasonable argument by showing that the elements (items) on the instrument are a 
representative subset (sample) of the universe being investigated . Other names for 
cohtenL validity are "face" validity and "logical" validity. It is usual- for content 
validity to be described in terms of the relevance of an instrument to different 
types of criteria, such as analyses of jobs or courses of study, statements of organi- 
zational objectives, concepts of social utility, collective judgments (panels) of 
competent persons, and logical (or psychological) analyses of behavior.' A simple 
example would be the use of arithmetic problems on an arithmetic ;te8ti j 

Contruc t validity . Construct validity , originally referred to as y^oncurrent" 
validity (Technical Recommendations, 1952), is . the most recently defined validation 
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category, having been formally described as "construct" validity in the Technical 
Reconmiendations of .1954. It (construct validity) is involved whenever an instrument 
is intended to measure attributes or qualities that are not clearly (operationally) 
defined, when the relationship between the instrument and the attributes or qualities 
to be 'studied is inferential (indirect) rather than specific. In general construct 
validity is used when neither content validity nor criterion-oriented models will 
suffice. ■ . ' ■ /•" • ^) ■. 

• . ■ . ■ . • ' ■ • • 

"Construct validity is ordinarily studied when the investigator has nor 
definite criterion measure of the. quality with which he is concerned, and 
must use indirect measures. Here the trait or quality underlying the 
instrument is of central importance, n . (Technical Recommendations, 1954)." 

Content validity, concurrent validity, and predictive validity are often con- 
sidered to be spccializef^ aftpL:c(.r> of construct validity when appropriate criteria 
are available. Construct validity is usually applicable to instruments that 
investigate things like study habits, appreciations, understandings, and interpre- 
tation of data. . 

Because of construct validity applying to areas' that are qualitative in nature, 
a structured approach to construct definition is important. To that end, Cronbach 
(Cronbach andMeehl, 1955) suggests the development of a "nomological network", for 
each contiUiuct to be evaluated. The characteristics of ' a nomological network are: 

1. The nomological network, itself , shall consist of a theory constituted 
of, an interlocking system of laws. ' ■ \ . 

2. The laws relate : - " a 

a. Observable properties or quantities to each other. 

b. Theoretical constructs to observables. 

c. Different theoretical constructs to each other. ^ ^ 

3. For a construct to be scientifically admissible, it must include at least 
some laws involving observables in its nomological nietwork. 

• ■ . ■ " . • ■/' ' ■ ■ . . . 

4. More is learned about a construct by elaborating the nomo logic a! ^network. 

5. Justifiable network enrichment occurs if it generates nomplogicals 
(laws or law-like statements) that are confirmed by observation or if 
it reduces the number of nomologicals required to predict the same, 
observations. ' . > 

6. Measurements which are qualitatively very different may be said to 
overlap or. to measure ' the same thing if their positions in the nomo- 
logical network link them to the same construct variable (concepts 
correlate with each other on an instrument in the way predicted by 
theory) . „ . 

In keeping with the perspective of a scientific approach, construct validation can 
be considered rigorous in that the nomological network makes contact with observa- 
tions and exhibits explicit, public steps of inference. When these conditions aire 
met. the investigator may justifiably claim construct validation (Cronbach and Meehl, ' 
1955). 
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Importance of validation , A test -or measurement instrument that has .not been 
subjected to rigorous validity studies is suspect i With standardized tests it is 
reasonable to expect the test manual to contain information about the method of 
choosing^ test items, the characteristics and ct^mposition of the sample (of popula- 
tion) upon which the test was' standardized , and\ the criteria used in validating the 
test. .Without such information the test may be considered of questionable value • 
Equally questionable is the value of reiSEearcli conducted using custom instruments 
that have not been subjected to similarly rigorou^^^scrutiny . 

Validity as applied to the instrument , \ . ' - 

The principal method of validation applied to the^^\ questionnaire is construct 
validity. There are , additionally , overtones of content: validity in that the 
constructs and their related no'mological network are derived from the literature 
of management and sociology. ^ 

The orientation of the questionnaire is toward obstacles to the successful 
conduct of problem solving and communication activities. In other words the con- 
structs that were developed were "obstacles to. problem solving" and* "obstacles, to" " 
communication." To. that end two levels of noraologicals (laws^^ or law-like statements 
within the nomological network), were developed for each construct. The first level 
consists of statements of specific obstacles to problem solving or cbnmunication. 
The second level of . nomologicals consists of conditions that are symptomatic of the 
specific obstacles. 

Reliability \ 

■ . r \ ■ ■ - ■,. : A / ■■ ■ 

The other consideration in the development of research instruments is reliability, 
which is. usually defined as the consistency with which an instrumentWields the same 
results in measuring whatever ttndbes measure. Reliability may existVfor an instru- 
ment without validity, since it is reasonable for- a test, for exainple(>\ to consistently 
measure something quite foreign to what was intended for i.t^ 

Reliability is in fact a class of characteristics that apply to dal:a collection 
instruments. The class includes stability, equivalence, and internal consistency. 



The methods of estimating reliability involve some way of obtaining at least 
two measures with the same instrument or equivalent instruments and determining the 
agreement between them. The closer the agreement between different applications of 
the same instruments^ the greater its reliability. - . . 

Test-re test method. The test-re test method of estimating reliability involves 
administration of the same instrument to "the same target population (or sample) on 
at least tijo different occasions. The results of the two administrations are corre- 
lated to estimate^ reliability. Tlve correlation coe'^f f icient that results is oft^n 
referred to as the "coefficient of stability (Remmers, I960)." Test-retest relia- 
bility measurement makes the assumption that there is no change in true scores \ 
between the two test administrations. 



Equivalent- forms me thod . The equivalent- forms method" requires the development 
of different versipns of an instrument that are essentially alike in the kind of. 
content, necessary mental processes, number of items, difficulty, and so on. The 
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subjects are administered one form ot t\\c instrument and, as soon as possible, the 
other form. A. correlntion coefficient, in this case called a "coefficient of 
equivalence (Remmers, I960)" is then calculated to assess agreement between the [■ 
forms. If agreement is high, each form.cMu be said to provide accurate measutoment. 

Split-halves method > The split-halves method divides the items of a single 
instrument into Halves, usually by randomly assigning items to each half or by pool- 
ing the even- nu^nbe red elements for one score and the odd-numbered elements for another, 
resulting in twoy instruments that are very much alike, including all of the. human 
related circums tgrices of administering the instrument, such as mental set, distractions 
fatigue, and so on. The results of calculating a correlation coefficient between two 
halves are a reflec_tion of the reliability of half of the instrument. Thie Spearman- 
Brown prophecy . formula allows estimation of the reliability of the whole test; 

Reliability of the lengthened test = nr 

' \ . " 1 + (n - l)r 

\ ■ ' ■ . 

Where n = -the number of times the instrumev.t is lengthened, ,and 

.r "= the) original reliability coefficient (Remmers, 1960). 



—Two other-formulas that do not require calculating a correlation coefficient . 

or correcting using tH'e Spearman- Brown prophecy formula are frequently used for 

estimating reliability. The first: / 

2 

So + 

r = 2/1 



"Habere s^ = the standard deviation of the firsr half, 

s^ = the standard deviation of the second half, and . 
s. =. the standard deviation of the instrument as a; whole. 



't, 

■ ' . ' 1 ■ ■ 



and the second: 
2 



r = 1 



^d 



where s = the standard deviation at the differences between half-instrument 

^ scores and the standard deviation of the total instrument, and '/ 



s = the standard deviation of the instrument as a whole (Renaners., 1960). / 



/ . 



' ' . . • • .-8" 

' Kuder and Richardson have developed d formula for estimating internal co.nsistency 

that has been shown to yield- a coefficient equal to the mean of all the'posslble split- 
half coefficients of an instrument, when ail items are scored 1 and 0. The formula, 
Kuder-Richard8on'8 ;'20'' is: 



r = 



- n - 1 ,8^ • . . • , 

where n « the number of items in the instrument, ^ 

= the standard deviation of the total instrument scores, 
p = the proportion of persons "passing**, each Item, and 
, * q = 1 - p (Kuder and Richardson, .1937). , 

■ . . ... . I _ 

' Cx:onbach has elaborated upon Kuder-Richardson' a '^20" with his coefficient Alpha, 
which iis a more general (allowing other than 0 and 1 as responses to items) formula: 

. \ ' ■ 

Alpha 



n - 1 




where s^ = the standard deviation of item scores after weighting, 

Sj. = the standard deviation of total instrument scores, 

which in turn reduces to kuder-Richardson!s "20" when all items are scored 1 and 0 
(Cronbach, 1951). Kuder-Richardson' s "20" and Alpha are considered as estimates 
of internal consistency. 

Factors affecting reliability . Three factors affect the reliability coefficient: 

1. The length of the instrument. * 

2. The range^ of talent among the participants'. 

3. The conditions i|inder which the instrument is administered. 

In the instance oi :he length of the instrument, all other things being equal, the 
longer the test the grcv^ter the reliability coefficient, up to point of diminishing 
returns. In the instance of range of talent or ^ability , the greater the variability, 
in the group of subjects, the highier the reliability coefficient. In the instance- 
of the conditions of administration, the greater the distractions, accidents, and 
cheating during the administration of the ins trument and the greater the scoring 
inaccuracy, the lower the reljiability coefficient. 
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Adequate reliability . The question arises as; to what^-constitutes an adequate 
coefficient* of reliability , particularly in-light of the obvious fact that no instru;- 

ment is perfectly reliable? The answor is that, depending on the circumstances, very. 

low values may be appropriate, but the higher the coefficient tiie better. The follpy- 
ing formula for the standard error, of a score: \- 



S.E. 



r 



tt 



where Sj. == the^tanidard deviation of t\ye^s€oxes on the instrument, and 



tt 



the reliability coefficient of the instr.umertt (Remmers, 1960), 



is a useful guide in de^xmlrfing what is an acceptable minimum reliability coeffi- 
cient. The results^of^his calculation is the probable range -below and above the 
score on the^peclCdied administration of the instrument within which an individual 
might be^expected to fall on repeated adminsitrations of the instrument. Thus, if 
theinvestigator is able to tolerate a relatively large range .of variance in scores / 
Jby^n individual on^repeated administratidhs of the instrument, a relatively low 
reliability coefficient may be acceptable, 

\ ' - ■ ' ■ , ■ ■ ' * . ■; 

Reliability as applied ' to the . iristrument 

In the development of ' an iristrument to accurately represent the nine obstacles 
to problem solving and communicajtion an internal consistency measure is- the mdst appro- 
priate, means of determining reliability. As a result, the decision was made to select 
Cronbach's Alpha to demonstrate reliability. The method of calculating" Alpha was not 
the exact method described earlier in this settion. Rather, than using the equation. 
(Cronbach, 1951): * ' ^ \ 

Z.'^i ■ ■ ■ ■ I ^ ■ / • ■ 



Alpha = 



n/ 



-n. -i 1 



where S:^ = the standard, deviation of item scores after weighting, e^nd 

Sf. = the standard deviar.ion of total instrument iscores , 

" • ■ \ . ■ \ - ■ ! 

w ■■ ' " • \ ■ ■ ^ 1 \ : • ■ ! 

the equivalent equation (Schuessler, 1971): j. 

Alpha V Mean Square (Blocks) - Residual , ' 
Mean Square (Blocks) 

\ \ • ■ ■ " ■ ■ ■ ' ' ' ^' 

where t^e mean square (blocks) and the residual are derived from an 

analysis of variance, 
was selected for use, = 
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As an additional measure of .int 
level nomologicals was correlated be 
lation. In addition the three sampl 
responses to the same. level nomologi 
measure does no'n flt neatly into one 

never- the-less, Vreliability-like," giving an indication of the similarity of response 
between selected Vgroups within the, test orgari^^ization and indicating consistency of 
appli.ca,tion of t He instrument to groups with different characteristics as well as the 
extent to which tpe items on the instrument ar^e homogeneous 



ergroup consistency the mean responses to flrst.-\ 
tween three distinct samples within the test popur . 
es ' mean responses were correlated with the "mean \ 
mis by \ the total t^st population. Although this \ 
of the recognized types of reliability, it is, 
n 

\ 



THE INSTRUMENT . • S. . , 

Organization of the instrument: • . * . . 

Three, types of questions were included in the instrument (Wasik, 1972). The first 
■type-of question, when viewed in light of the complete set df questions; constitutes . 
a symptomatic diagnostic system f or deterrming' the presence of the first-level nomologi- 
cals, which are in turn specific obstacldis to -f^roblem solving and communication. The 
symptoms, which are the second-level nomologicals , are restated as one or more ..ques- 
tions, each, that are answerable by either yes of no'. The sequence of- appearance of 
questions on the in^strument was arrived at rancjomly,' There were originally 55 • questions- 
of this type on the instrument w^en it was administered to the test population* Two * 
questions were subisequently eliminated because- of wording problems . / 

The second type of question was a restatement o'f. the first-level nomologicals so 
that they copld be responded to on a ten point rating scale (O", through 9) , with the 
responder^ts 'indicating their opinion as to the extent to which . the nomologicals were 
present iln the organization. The third type of question'was also a restatement of theA' 
first-level nomologicals so that they too could be responded to on a ten point rating 
scale.. In- this instance, howiever, the respondent, indicated. His opinion as to thje 
extent to which the presence of the noraologlcal interfered witTi the performance /of 
his dutlesl The second and third types of questions were randomly mixed together arid 
were treated as a second section of the instrument. ^ I 

In addition to the three itypes of construct i^elated questions, four demogrkphlG, 
items were included. They were s ex ^ number of ye^r education, age, and racle. The 
purpose for inclusion of these items was to provide for correlations of responses be- 
tween various types ^of participants. This was^ done • at the specific request of the 
executive level management of the test case o4:ganization. 

Validity 

The' TOmologica^ network . The following is an example of the development of the 
nomologicals and their related questions "for the first type of question: 

1. For the first-level nomologicaL, "Lack of clarity in stating the problem," 
t\)^e second-level, nomologicals and corresponding questions '-^are : 

a. Inadequate time 'is available to analyze problems so that they are 

. not thoroughly understood (Lippitt, 1969) . ... ^ ' / 

1) Do you have adequate time to. analyze problems to the point- where 
you thoroughly understand them? -\ 

2) When working in a group ; problem solving situation, does the ...^^^^ 
group, take the time to be sure everyone understands each problem 
before attempting to select a solu^tlon? ^ ' 

3) When you first encounter a problem^ is its exact nature usually ' ^. • 
clear to you, Immediately? • ■ t 

b. A good decision depends on the maker being consciously aware of all 
the factors that set the stage for the decision (Massie, 1964). 

1) Are solutions to a problem usually tried, even though the problem 

I is not well understood? , . . , - - 

' c. A problem must be well-defined to be well-solved (Dewey, 1910). 

1) Do you feel that an inadequateily stated problem will be poorly 
solved? 
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^ The following are examples of the development of the nomologicals and their 

related questions for the second type of question: 

The following obstacles and the related questions are associated with the 

construct, "Obstacles to problem solving:** 
•« . 

1. For the first-level nomological, "lack of clarity in stating the problem," 
the rating scale item is: 

/ a. Does the tendency to seek solutions to Inadequately stated problems 

/ 1 inte rfere with your ability to do y our job? 

70' Alv/2 /3 /4 /5 /6 /7 /8 /9 7 



iirst-ievel 



2. For the first-level nomological, "premature testing of alternatives," 
the rating sqale item is: 

a. in the group decisUon-making proc,ess does premature evaluation of 
alternative problem solutions produce results, that interfere with- 
your doing your job?. ' * 



. ^ 70 /I /2 73 M /5 /6 /7 /8 79 / 

■ . . ' . , • 

The nomologicals and their corresponding questions for the third type of question 
w^e developed exactly as were those for the second type of question.- ' 

Linking the nomological network - with observables * In addition to development of 
the nomological network, which is derived from the literature and which in effect 
predicts the relationships between the concepts being^ studied and the items on. the 
instrument,, it is essential that the nomological network makes contact with empirical, 
obseryatioris (Gronbach and Meehlj 1955). Toi that end a factor analysis was run using 
the Statistical Analysis System (Service, 1972) . An orthogonal rotation was used in 
the factor analysis to allow maximum independence between factors as they relate to 
" items. Input data to the factor analysis were the 73 responses to the instrument's 
^ items for. .the 118 respondents in the^test case. 

^ - Twenty-five factors resulted from the factor analysis. Examination of the Rotated 
Factor Matrix was directed toward linking questionnaire items with first-level nomo-- 
logicals. The. minimum factor loading, the weight of a, factor relative to all other 
factors (Schuessler, 1971), that was considered significant was 0.35. 

Figure 1 is a sample of a summary of the significant factor loadings as they 
appear in the rotated factor matrix. The item number and the related first-level 
^ nomological number are also included. All items were significant fol: at least one 
factor.. In reading Figure:-!^.!^ under each factor for item information in' the 
■following format: ' ' . - 

!^ ■' ■ ' ■ ■ ■ — / ... . ■ ■ ■ ■ 

On the first line... - \^ 1 

Part of the instrument (i\e.i B) , idem number (i.e., i24), .^-^ 

.. .dash. . .'number of the related f irst-level nomologicals 

On the second line. 

Factor loading. 

Figu^re 2 is a sample of an additional level/ of summation-J..n that items and factor 



lofidlngs from the Rotated. Factor Matrix are linlced with their related^ firs t-~level and 
second-level nomologicals. A logical relationship may be described " forthe-.^^ ems 
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FACTOR 



/ 



- 1 

B24 - 5 
-0.36547 

B28 - 4 
-0.37180 

B33 - 8 
-0.39484 

841 - 4 
-0.36365 

C V - 7 
-0.65291 

C 2 - 8 
-0.77649 

C 6 - 6. 
1-0 .,581 16 

C 7 - 7 
-0.53657 

C 8 - 8 
-0.69601 

C 9 - 8 
-0.73089 

CIO - 9 
-0.70519 

CI 4 - 2 
-0.44544 

C15 - 3 
-0.64082 



2 

B18 - 7 
-0.41405 

B31 - 8 
0.78654 

B38 - 2 
0.62002 



3 

B23 - 4 
0.70637 

B25 - 8 
-0.37278 

B27 - 8 
-0.36717 



4 

B 8 - 8 
0.40173 

B17 - 5 
-0.82130 

B42 - 5 
-0.41854 

B47 - 3 
-0.71176 

848 -.6 
-0.46398 



5 

B28 - 4 
0.55539 

B32 - 7 
0.40663 

B35 - 4 
-0.50354 

B49 - 5? 
-0,70341 



B48 - 6 
0.39593 



/ 

/ 



SAMPLE OF ROTATED FACTOR MATRIX, SUMMARIZED 



Figure 1 
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appearing in each selected factor. The numbers for first-level nomologiCals and the 
identifiers (alphabetic character) for second-level nomologicals that appear in Figure 
2 are those usecj/ln '*The nomological network for obstacles to problem solving" and . 
"The nomological network for obstacles to communication" from which samples appear 
earlier in this pap^r. The item nunb er is a combination of the Part of the instrument 
and. the item number^ as they appear on the instrument. 



FIRST-LEVEL 


SECOND-LEVEL 








NOMOLOGICALv 


. NOMOLOGICAL 


ITEM 


FACTOR 


FACTOR 


NUMBER ^ 


IDENTIFIER, 


. NUMBER 


NUMBER 


LOADING 


1 


a'^ , ■ 


BIO 


, 10 ' 


-0.62103 


• 1 


c 


B51 


' 10 


0.40248 


1 


a. 


B 6- 


12 


0.76547 


1 




C13 


24 


0.43776 


2 


c 


B52 


17 


0.82616 


2 


a 


B 1 


18 


-0.79760 


2 


a ■ 


B 5 


21 . . 


-0.74821 



SAMPLE OF 

RELATIONSHIPS BETWEEN SIGNIFICANT FACTOR LOADINGS 
AND NOMOLOGICALS i 



Figure 2 

\ Figure 3 is a sample of all of those factors that. appear in Figure 2, with all of 
theiitems within those factors whose factor loading exceed 0.35 being described. The . 
entire item is. stated so that the logical relationships between the items may be observed. 

Briefly reviewing, Figure 1 identifies all of the items with respect.. to their 
factors, where the factor loadings for tlie items with respect to the factors exceed 
0i35. . Each of the items on the instrument loaded above 0.35 on at least one factor; 
thus, there is a . relationship that may be considered significant between each item 
and at least one factor. • - 

' ■ . ■ \ / 

Figure 2 is derived from the information in Figure 1. Its contents represent the 
cases where an item clearly relates to first-level and second^level nomologicals in 
the factor analysis. It alsb establishes interrelationships between factors, as they', 
appear in the Rotated Factor Matrix, where two or more factors may be presumed to 
represent different aspects of the same dimension. 



FACTOR 1 



ITEM 

DESCRIPTION 



B24. 

B28. 

B33. 
841. 

C 1. 

C 2. 

C 6. 



C 7, 

C 9 .^ 

CIO. 
Cl'4. 

CI 5. 



Do you feel that the working climate is so 
repressive that it prevents your making 
your best contribution to the problem 
solving process? 

Are there members of the problem solving 
groups with which you work who consistently 



block the group from success 
decision-making process? 



in the 



FACTOR 
LOADING 

-0.37547 



-0.37180 



-0.39484 



Do^you often withhold . essential information 
from the people for whom you work? 

Do you feel that there are many members of _ -0.36365 
the problem solving teams to which you belong 
who could be described as "recognition seekers?" 

Do you feel that people.., with management -0.65291 
responsibility should operate only within 
the formal communications structure? 

How often do you find that you are uncertain -0.77649 
about-what information is needed at higher 
levels in the organization? 

Does pressure to conform to the behavioral -0.58116 
standards and views of the problem solving 
groups with which you work interfere- with -^j • 
your doing your job?. v}. j 

Does lack of understanding of ^the formal -p. 53657 
communications structure interfere with 
your doing your job? 

Does withholding of essential information -0.69601 
by higher management from lower management 
effect your ability to do your job? 

Do vested interest groups interfere with • -0.73089 
the operation of the organization? j 

In the group decision-making process .does / -0.70519 
premature evaluation of alternative problem 
solutions produce results that iriterferG / 
with your doing your job? ■ 

Does lack of decision-making skills on the -0/44544 
part of team leaders and/or team members 
interfere with your doing your job? / 

SAMPLE OF ITEM DESCRIPTIONS WITHIN FACTORS 



Figure 3 
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Figure 3 expands on the factors in the Rotated Factor Matrix that were used in 
Figure 2. Where Figure 2 displays selected items with a factor loadingv greater than 
0.35 to establish relationships between observables and the nomologicals as^ predicted 
by the noraologlcal network, Figure 3 displays all items with a factor l/oading of 0.35 
or greater for each factor that was used in Figure 2. Figure 3, then/provides a 
means for viewing the subjective logic of the interrelationships between significant 
items in the selected factors as found in the Rotated Factor Matrix and provides a 
representation of factor s a's they occurred in the reality of the test case. 

As expected, ' the constructs (nomologicals) are not unldiraenslonal. The factors 
as derived from the literature seem to be tapping different dimensions as 'evidenced 
- by the variation of the factor analysis from the theoretical network of nomologicals. 
This suggestion of the measu'rement of several not unexpected dimensions of the con- 
structs is the probable result of the trade-offs between theoretical purity and the 
utility of the instrument needed for measuring the real social situation of the test 
case. A ' 

The factor analysis ppints to a relatively high interrelationship between the 
first-level nomologicalsV '-Not all the nomologicals were fully supported in. the 
factors shown in Figure'' 2 and in Figure 3, but all the factors are supported by the 
Rotated Factor Matrix as exemplified by Figure 1. The factor analysis can be said 
to support the nomological network, so that observables are related to first-level 
and second-level nomologicals. 

Statement of validity . The nomological network has been developed so that one 
can relate to the logic of its development. Through the use of .factor analysis it 
has been shown that there are clear linkages between the network and observables 
(obtained in the test case). Based on the logical development fp the network and 
the. established contact between the network and observables, construct validity may 
be claimed for the instrument. 

Reliability ; - 

An analysis of variance was produ^ied using the Statistical Analysis System 
(Service, ^972) at the Triangle Universities Computation Center through the Computer 
Center at North Carolina State University. The following results were generated: 



StmCE 
Blofcks 
I tern 

Residual 
Corrected Total 



DF SUM OF SQUARES 

117 816.6842 

72 11332.2644 
8178 8773.0700 

8367 • /2f6922.0186 



MEAN SQUARE 
. . 6:980207 
157.392561 
1 .072765 
2.500540 
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ANALYSIS OF VARIANCE TABLE ^ FOR TEST CASE DATA 

Figure 4 
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The mean square (blocks) and the residual from the preceding figure. were used . in the^ 
following equation: 

Alpha = Mean Square (Blocks) - Residual , 
\Mean Square (Blocks) 

Alpha « 6,980207 - 1,072765 

6.980207 _ . - 

Alpha ^ 0.8463132 ' ' 

This value for Alpha is accepted as adequate' evidence of internal consistency (relia- 
bility) based on the acceptability of the standard error of a score on the instrument 
as derived below: 



vS.E. 



tt 



S.E. = 23.038662 i/ 1 0.8463132 ' ' 
S'v^. = 9.0318236 

^ As additional evidence of reliability, the data in Figure 5 were used to. produce 

a correlation between mean responses by distinct samples within the management popula- 
tion of the test organization. In Figure 5 observations 1 through 9 are the average 
or mean re^sponses to the diagnostic type questions. Observations 10 through 18 are 
the average or mean responses to the ratings of presencie of the bbstaclps. Obser- " 
vations 19 . through 27 are the average or mean responses to the ratings of the extent 
to which the obstacles interfere with the participants doing their job (Crumpton, 
1973).. The correlation was run on this data set to produce the results shown in 
Figure 6. . 

The resulting correlations between the groups were very high. In eyery instance 
thie probability of the similarity ' between responses being by chance* alone was one in 
10,000 or less (the 0 .0001. level) . In other words, the responses p£ all' participant 
groups were very much alike. Figure 6 represents the output of the computer run. 
All labels are the same as those used in Figure 5. : . 4 

Based on the statistics described in this section it may be concludeci that the / 
questionnaaire displays a high degree of "reliability. It can also be expected to give 
consistent results with a varied group of participants within the target organization. 



< 




OBS 


^ OVERALL 


GROUP A 


GROUPS 


OTHERS 






n /IKK 




■ n cm 




0.414 


0.333 


0.444 


0.429 


\3 


0.381 


0.313 


0.389 


0.409 




. 0.270 


0.286 


0.226 


0.275 


5 


0.280 


0.299 


0.250 


0.288 


6 


• 0.394 


0.394 


. 0.361 


0.392 


7 


0.413 


0.459 


0.250'' 


0.493 


8 


0.332 


0.303 


0.329 


0.334 


.9 


0.689 

■ 


0.545 


0.792 


0^^7J 


10 


3.000 


2.909 


4.250 


2.853 ^ 


11 


2.924 


3.182 


2.833 


2.905 


12 


3.534 


3.636 . 


3.167 


3.568 


1.3 


2.492 


2.818 


2.750 . 


2.421 


14 


2.322 


2.273 


3.750 


2.147 


J5 


2.303 


4.273 


2.917 


3.116 


' 16 


6.136 


5.273 


5.667 


6.295' 


, 17 


2.992 


2.364 


2.750 


3.095 


vl8 


- 3.381 


4.318 


3.169 


3.300 



19 

20. 

21 

22^ 

23"^ 

24 

25 

26 

27 



2.237 
2.110 
2.195 
1.780 
1.873 
2.008 
1.568 
1.958 
2.008 



1.636 


2.417 


2.285 


2.182 


2.417 


2.063 


2.273 . 


2.583 - 


2.137 


2.364 


1.917 


1.695 


1.727 


2.083 


1.863 


3.000 


2.750 


1.800 


1 .000 


1.417 


1.653 


1.636 


2.875 


1.879 


1.909 


2.000 • 


2.021 



LISTING OF^fNPUT DATA FOft CORRELATION BETWEEN 



OVERALL, GROUP A, GROUP B, AND OTHERS 



Figure 5 
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N = 27 



/ 

OVERALL 




OVERALL 

1 .000000 
0.0000 



GROUP A 

0.920350 
0.0001 

1.000000 
0.0000 



GROUP B 

0.946753 
0.0001 

0.901619 
0.0001 

1.000000 
0.0000 



OTHERS 

0.991552 
0.0001, 

0.932028 
0.0001 

0.930691 
0.0001 

1.000000 
0.0000 



CORRELATION BETWEEN RESPONSES OF 
OVERALL, GROUP A, GROUP B, AND OTHERS 
(CORRELATION COEFFICIENTS / PROB > |R| UNDER HO: RHO 



= 0) 



Fitj ure 6 
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Six of the many possible obstructive factors relating to problem solving that 
are identified as being of importanre aro (LLppltt, 1969): 



\ 1 / L ack of c larity in stating the problem. An iTl -stated problem 

is essentlTliyijnsol"va&le": ~ ~ ~ — — — 

'. . . ^ * 

2. ' Premature testing of alternatives in making decisions. In the 
. problem solving situation managers tend to take each problem 

to be solved and treat it individually rather than accepting 
a variety of problems and addressing them, in-so-far as^.possi- 
ble, as a unified whole; thus, losing the benefits of ex- 
ploring the interrelationships among problems. 

3. Lack of diacision-making skills. Decision-making is a highly 
demanding and extremely complicated cognitive and emotional .\ 
process. It needs to be continuously seen in both of those j 
dimensions. Strong, well-trained, leadership seems to produce ' 
the most effipient decision-making. Group members should also | 
become strong diagnosticians and interveners. 

4. Self-oriented behavior. The individual *s conflict- with the / 
^ decision-making group because of a strong self-orientation 

causes the individual to appear obstructive and reduces . , - 

group problem solving, effectiveness. 

5. Unsatisfactory working climate. The individual functions 
most effectively within the group problem solving, situation 

~~ ___whei n he h as a high, degree of. security. The following equation 

is intented~^td~be-"a~simpTe-representation of the security 

situation: 

. ■> " • ■ ■ . 

Security = Perception of own power + Friendly forces . . 
■■■ '■ Unfriendly forces . 7" 

6. Conformity. and homogeneity. Group pressures encourage con- .. ' 
formity among managers to the detriment of creativp decision- , 
making. Groups seeking better decisions may expand their 

- norms to increase tolerance of unconventional contributions. - 

Better choices should emprge from an enlarged repertoire of 
alternatives. ' 

Many obstructive fa'c^toirs that interfere, with comraunicatiori within organizations 

have been identified. The following three (Sitnpn, 1957) were selected as relative 

to. the study: - ■ ■ [ ; * 

7. Lack of understanding of the formal organization. Tfie ' • 
formal organization is, articulated to facil itate the/ opera- 
tion of the organization. Uncertainty or ignorance of its.. 

\ operation interferes with efficient communication of needed 
information to correct positions in a timely and appropriate 
mariner, often resulting in the development of cliques. 
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8. Not providing the types pf information needed at other \ 
organizational levels. A major problem of higher levels of 
the management h'ierarchy is that much relevant information 
originates at /lower levels and may not reach higher levels 
unless the executive is extraordinarily alert. A system of 
formal records and reports, for example, places the respon- 
sibility forj^defining information to be transmitted in the 
hands of th^ superordinate rather than the subordinate. 
The conver^^e situation occurs when the superordinate with- 
holds needed information from the subordinate either through 
ignorance or because of a wish to maintain or strengthen his 

-authority relationship with. the subordinate. 

9, The presence of management cliques. Informal organizations 
tend to form as organizations, grow and become more complex, 
as the means of communication established by the formal 
organization become less effective. 



